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Modularity produces small-world networks with dynamical time- 
scale separation 
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Abstract. - The functional consequences of local and global dynamics can be very different 
in natural systems. Many such systems have a network description that exhibits strong local 
clustering as well as high communication efficiency, often termed as small- world networks (SWN). 
We show that modular organization in otherwise random networks generically give rise to SWN, 
with a characteristic time-scale separation between fast intra-modular and slow inter-modular 
processes. The universality of this dynamical signature, that distinguishes modular networks from 
earlier models of SWN, is demonstrated by processes as different as spin-ordering, synchronization 
and diffusion. 
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In many natural situations, dynamics at the local level 
may occur at a very different time-scale compared to pro- 
cesses taking place on the global level. Such temporal sep- 
aration is often desirable functionally, e.g., for information 
processing in the brain, which requires synchrony between 
local areas processing specific stimuli [1] but where global 
or very large scale synchrony is considered pathological as 
' in epilepsy [2] . Many systems in nature have network de- 
scriptions, with the connection topology playing a crucial 
role in determining their dynamical behavior [3]. There- 
fore, it is of considerable interest to understand how the 
structural organization in complex networks can give rise 
. to dynamics at multiple discrete time-scales. 

A large class of networks in nature have been reported 
to be small- world networks (SWN) [4], which are charac- 
terized by the coexistence of very high clustering among 
neighboring nodes and low average path length. The 
clustered structure of SWN distinguishes them from net- 
works with "small- world property" [5] , whose average path 
length increases slower than any polynomial function of 
the system size, a feature seen in random graphs as well 
as most complex networks [6]. SWN have been reported 
in a variety of contexts, including the brain [7-9], human 
society [10] and cellular metabolism [11,12]. Several mod- 
els for SWN have been proposed [13], beginning with a 
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simple interpolation scheme between regular and random 
structure through rewiring of links (the WS model) [4] 
[Fig. 1(a)]. This creates a few long-range links that act 
as "shortcuts" between otherwise distant nodes, substan- 
tially decreasing the average path length of the graph. 

In this paper, we relate the apparently independent 
properties of dynamical time-scale separation and the clus- 
tered small- world property of many complex networks, 
with the crucial observation that such systems often man- 
ifest modular structure [14]. Modules are defined as sub- 
networks comprising of nodes connected to each other with 
a density significantly higher than that of the entire net- 
work. Modular structures have been observed in a wide 
variety of contexts, from cellular metabolism [15] and sig- 
nalling [16] to social communities [17], internet [18] and 
foodwebs [19]. We use a simple model of modular net- 
works that exhibits all the structural characteristics of 
SWN, to explore the dynamical consequences of modular- 
ity. Such modular networks, in sharp contrast to previous 
models of SWN, exhibit distinct time-scale separation in 
their dynamics, corresponding to fast intra-modular and 
slow inter-modular processes. We show the universality 
of this behavior by using three very different types of dy- 
namics, viz., (i) the ordering of spins through exchange 
interactions, (ii) synchronization among strongly nonlin- 
ear relaxation oscillators and (iii) diffusion. In all cases, 
the modular configuration allows coordination within local 
clusters to occur much more rapidly than global ordering. 
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The occurrence of multiple discrete time-scales in such a 
wide variety of systems highlights the role of modularity 
in the dynamics on complex networks. Using this dynam- 
ical signature it should also be possible to identify those 
real-world systems whose SWN property is a consequence 
of their modular organization. This is crucial for design- 
ing intelligent intervention strategies for complex systems, 
e.g., controlling epidemics. 

The network model considered in this paper follows di- 
rectly from the definition of modular networks and con- 
sists of N nodes arranged into m modules (similar to the 
construction used, e.g., in Ref [20]). Each module contains 
the same number of randomly connected nodes [Fig. 1(b)]. 
The connection probability between nodes in a module is 
Pi, and that between different modules is p . The pa- 
rameter defining the model is the ratio of inter- to intra- 
modular connectivity, fe = r £ [0,1]. For r — > 0, the 
network gets fragmented into isolated clusters, while as 
r — ► 1, the network approaches a homogeneous or Erdos- 
Renyi (ER) random network. 

We observe that such modular organization gives rise 
to SWN whose structural properties are very similar to 
those of networks generated by WS and related models. 
These properties include the communication efficiency of 
the network, defined as E = i N ^ N _ l s j Yli>j which 
measures the speed of information propagation over the 
network [21]. Here, dij is the shortest distance between 
nodes i and j. For small r, as most links are within 
a module, E is low, while at large r, E becomes high 
when the number of inter-modular links increases. We 
have also measured the clustering within local neighbor- 
hoods, C = (l/N)'^2 li 2ni/ki(ki — 1), where fcj and are 
the degree and number of links between the neighbors of 
node i, respectively. For modular networks with large m, 
clustering is high at low r and decreases with increasing 
r. The SWN property, viz., the coexistence of high E 
and high C, is observed in the model for an intermediate 
range of r [Fig. 1(c)], exactly as seen in the WS model for 
intermediate rewiring probability p [Fig. 1(d)]. 

We also compare between these models by using a mea- 
sure for network modularity, Q = X^=i T — (it) 
where m is the number of modules into which the net- 
work is partitioned [22], L is the total number of links, 
and l s and d s are the links between nodes and the total 
degree of all nodes belonging to module s, respectively. 
For N nodes with average degree (k), the WS model has 

a maximum Q value of (1 - p) 1 - ^{(k) + 2)/N\ , and 
is very high at low p. Similarly, for modular random net- 
works, Q = ^(j^+'ml-mp which also y ields vei T high- 
values at low r, where Q ~ (1 — mr) [Fig. 1(e)]. This 



^1 — r+rm) — '/ 

where Q ~ (1 — mr) 
implies that community detection algorithms which use Q 
will be unable to differentiate between these two networks. 
Other methods, such as, the fc-clique percolation cluster 
technique [23] indicates high local link density relative to 
the overall connectivity for both the models. Thus, it is 




Fig. 1: Schematic diagrams of (a) Watts-Strogatz (WS) model 
and (b) modular network model (modules indicated by broken 
curves). Efficiency E and clustering coefficient C for (c) mod- 
ular random network with m = 16 modules as a function of 
r and (d) WS model as a function of rewiring probability p 
(for all cases TV = 512, (k) = 14). Error bars are in all cases 
smaller than the symbols used, (e) Modularity measure, Q 
vs r for modular random network, and, vs p for WS network. 
Intersection of the two curves with the dotted line (Q = 0.7) 
provides r, p values for comparing the model networks. 



difficult to distinguish between WS and modular networks 
with extant measures that use only structural information. 

However, apart from topological structure, networks are 
often associated with certain dynamics [24]. As dynam- 
ics is often crucial for the functioning of many systems, 
we now examine three very different dynamics on net- 
work models having the clustered small-world property. 
These dynamics range from nonlinear interactions (repre- 
sentative of collective ordering in a network) to strongly 
nonlinear local dynamics at each node (as in relaxation 
oscillators) with diffusive coupling. As the WS model is 
parametrized by p and the modular random networks by 
r, we compare between them by considering networks with 
the same N, (k) and Q. 

We first consider the effect of modular organization 
on the emergence of collective behavior, a simple model 
of which is the ordering of Ising spins arranged on a 
network. This system is described by the Hamiltonian, 
H = — J2i j JijViVji where, <Ji,Oj = ±1 are spins placed 
on nodes i, j, and Jij is the ferromagnetic coupling be- 
tween them (= J > if i, j are connected and other- 
wise). Starting from an initial random configuration of 
spins on a modular random network with average degree 
(k), the system is allowed to evolve to its ground state 
using Glauber dynamics. This corresponds to a globally 
ordered state [Fig 2 (a)] if T < T c (= (k)), the mean- 
field critical temperature measured in units of J /ks (ks- 
Boltzmann constant). We observe that the time (T gm ) 
needed for magnetization M — ^2f =1 &i/N to reach its 
high asymptotic value, diverges as r decreases. This is 
because, at low r, the system remains for a long time in a 
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Fig. 2: Schematic diagram of (a) global ordering (M — 1, 
M m = 1) and (b) modular ordering (M = 0, M m = 1) in a 
modular network of Ising spins. 



state of modular ordering [Fig 2 (b)], where the spins in 
each module are ordered but aligned in opposite directions 
in different modules which results in the absence of global 
ordering. The local order parameter, modular magnetiza- 
tion M m = (m/N)( \ ^2 iek cf|), where a\ is the i— th spin 
in the k-th module and the averaging is over all modules, 
exhibits convergence to its asymptotic value over a time- 
scale r mm , which is almost independent of r. Fig. 3 (a) 
shows the existence of two time-scales which diverge at 
low r indicating the ordering process within modules to 
be much faster compared to that between modules. At 
low temperatures, as the spins within each module get or- 
dered, different modules may get aligned in opposite direc- 
tions. To achieve global order, some of the modules need 
to turn all their spins, a process that has a considerable 
energy barrier. To cross this with thermal energy takes 
extremely long times, resulting in divergence of r gm . A 
similar investigation of the WS network shows only global 
ordering, with T grn diverging as p decreases. Related dy- 
namical processes where the appearance of distinct time- 
scale events as a consequence of modular network struc- 
ture have important functional significance, include the 
adoption of innovations [25] , spread of epidemics [26] and 
consensus formation [27]. 

Next, we compare the dynamics of synchronization in 
modular random and WS networks. We consider a popu- 
lation of N coupled relaxation oscillators (described by a 
fast variable x and a slow variable y) which evolve as 
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Here, c is the ratio between time-scales of x and y. 
Kij = nAij is the coupling between a connected pair of 
oscillators with strength k, and A is the network adja- 




Fig. 3: (a) The two time-scales corresponding to local order- 
ing within a module (r mm ) and global ordering over the entire 
network (j gm ) for a modular random network of Ising spins 
(m = 16) at T = 6 as a function of r, showing their divergence 
at low r. (b) Comparison of synchronization between modu- 
lar random networks (m = 16) and WS networks of relaxation 
oscillators (Eqs.1-2) with c = 2 and k = 1.5. In modular 
networks, the two time-scales corresponding to intra-modular 
(tms) and global or inter-modular (t ga ) synchronization are 
shown as a function of r. The WS model exhibits only the 
time-scale corresponding to global synchronization (inset). Av- 
eraging has been done over random initial values and network 
realizations. (In all cases TV = 512, (k) — 14). 



cency matrix, i.e., Aj 



1 if i,j are connected and 



otherwise. The local dynamics of these relaxation oscil- 
lators is strongly nonlinear compared to, e.g., Kuramoto 
oscillators, networks of which have been previously shown 
to approach synchronization exhibiting temporally vary- 
ing patterns that are intrinsically related to the underlying 
connection topology [28]. The time-evolution to synchro- 
nization (i.e., Xi = x, yi — y, Vi) is analyzed using the 
pair-correlation function between oscillator phase angles 
9 [= arctan(y/x)], Pij(t) — (cos[0j(i) — 0j(t)]), where (...) 
is an average over random initial conditions. The fraction 
of synchronized nodes f syn c is obtained from the corre- 
lation matrix p by introducing a threshold. We observe 
that f S y nc increases continuously to 1 (i.e., global syn- 
chronization) for WS networks. In contrast, the synchro- 
nization occurs over two distinct time-scales in modular 
random networks. At the relatively shorter time-scale of 
tms, local synchronization occurs among nodes belonging 
to the same module. Global synchronization occurs over 
a comparatively longer time-scale t gs , with the synchro- 
nized clusters remaining fairly stable in the intervening 
time-period. Fig. 3(b) shows the variation of these two 
time-scales with r, converging when the network becomes 
homogeneous (as r — ► 1). 

In the real world, for many systems the coupling 
strength between nodes within the same module may dif- 
fer significantly from that between nodes belonging to 
different modules. For example, a recent study of tie 
strengths in mobile communication networks [29] observed 
that links connecting different communities tend to be 
weaker than links between members of the same com- 
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Fig. 4: (a) Dependence of the two time-scales corresponding to 
modular (t ms ) and global synchronization (t gs ) on the ratio of 
the inter and intra modular coupling strengths (ninter / Kintra) ■ 

(b) The two synchronization time-scales shown as a function of 
a constant delay St between any pair of connected oscillators. 

(c) Variation of tms and t gs with random inter-modular cou- 
pling delays, that are distributed uniformly between [0, Stmax]- 
In this case, there is no delay for intra-modular couplings. Note 
that, T 03C is the time-period for an uncoupled relaxation oscil- 
lator. (In all cases N = 512, (k) = 14, m = 16 and r = 0.02). 

munity, supporting a well-known hypothesis for social 
networks [30]. Hence we look at the effect of different 
strengths for inter- modular coupling (Ki nter ) and intra- 
modular coupling (Kintra) on the synchronization behavior 
of oscillators on a modular network. As the inter-modular 
coupling strength becomes weaker relative to the intra- 
modular coupling, we observe the time-scales for modular 
and global synchronization to diverge (Fig. 4, a). Thus, 
in real systems where inter-community ties are relatively 
weaker, the time-scale separation between local and global 
events will be even more prominent. On the other hand, 
as the inter-modular coupling strength becomes large, the 
two time-scales gradually converge. As expected, at very 
large values of the ratio Kinter '■ Kintra, global and modular 
synchronization occur simultaneously. 

We have also looked at the more general case of syn- 
chronization in the presence of delays in the coupling [31]. 
Even in the presence of delays, we observe distinct time- 
scales for modular and global events. If St represents the 
delay period (i.e., the time required for signals to travel 
from one node to another through a link), the coupling 
terms of Eq (1) become: 

N K 

J2^[ Xj (t-6t)- Xi (t)}- (3) 

3 = 1 

For constant delay (i.e., St = constant, for all pairs of 
connected nodes), we observe in Fig. 4 (b) that the time 
required for modular synchronization (r ms ) is shorter than 
that required for global synchronization (t 5s ), although in 
general both are longer than their corresponding values in 
the absence of any delay (St = 0) considered earlier. We 
also consider the case where coupling delays are random 
and chosen from an uniform distribution. As in the case of 



Fig. 5: (a) Distribution of first passage times (FPT) for diffu- 
sion process among nodes in a modular network (m = 16, r = 
0.02,7V = 512, (k) = 14). The inter- and intra-modular FPTs 
indicate two distinct time-scales for random spreading, the pro- 
cess occurring much faster within a module than between mod- 
ules, (b) The Laplacian spectral gap between the m-th and 
(m + l)-th eigenvalues increases with decreasing r, shown for 
different system sizes with the number of modules m = 16. 

coupling strengths k, the delays may differ for connections 
between nodes belonging to the same module as opposed 
to those belonging to different modules. For example, 
this may arise if nodes within a module are geographically 
closer to each other, relative to nodes in other modules. 
Therefore, we look at the case when there is no coupling 
delay within a module, while, the delay for connections 
between oscillators in different modules is distributed over 
the interval [0, 5t max \. In Fig. 4 (c), we observe that as 
in the case of constant delay, the inter-modular synchro- 
nization takes significantly longer time than intra-modular 
synchronization, emphasising the generality of our results. 

The existence of such distinct time-scales as a conse- 
quence of modular structure also appears in other dynam- 
ical processes, e.g., diffusion. Consider a discrete random 
walk on a network, where the walker moves from one node 
to a randomly chosen neighboring node at each time step. 
We analyze the time-evolution of the diffusion process by 
obtaining the distribution of first passage times for ran- 
dom walkers to reach a target node in the modular random 
network, starting from a source node [32]. Fig. 5(a) shows 
that this distribution differs quite significantly depending 
on whether the target node belongs to the same module 
as the source node or in a different module. This again 
suggests two distinct time-scales, with intra-modular dif- 
fusion occurring much faster than inter-modular diffusion. 
This is consistent with the results of Refs. [18, 33] where 
the degree of isolation of a module was assessed by com- 
paring the participation of its nodes in different diffusion 
modes, using the internet as an example. 

The occurrence of dynamical time-scale separation in 
modular networks can be understood analytically for dif- 
fusion and synchronization (under linear approximation) 
using a common framework. Although the oscillators we 
have considered are strongly non-linear, by linearizing 
the dynamics of the phase angle 9 around the synchro- 
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Fig. 6: Rank index i plotted against the inverse of the cor- 
responding eigenvalue of the laplacian matrix Jzf for modular 
random network (m = 16) at different r (A-C) compared with 
that of WS network at different p (D-F), indicating the exis- 
tence of a distinct spectral gap in the former at low r (N — 512, 
(k) = 14). 

nized state, their dynamics can be described as: = 
— ■^-^2jLij0j, where L is the Laplacian matrix of the 
network, with Ln — k t and Ljj = —A+j (for i ^ j). 
The normal modes are fi{t) — *fi(0) exp _Ai *, where Xi 
are the eigenvalues of L = D _1 L (D is a diagonal 
matrix with Da = hi). All the eigenvalues are real 
as L is related to the symmetric normalized Laplacian 
i tf = D5LD~ through a similarity transformation. The 
mode corresponding to the smallest eigenvalue is associ- 
ated with global synchronization, while other modes pro- 
vide information about synchronization within different 
groups of oscillators. Difference in time-scales of the dif- 
ferent modes is manifested as gaps in the spectrum of Jz? , 
which we indeed observe for modular random networks. 
The gap between modes corresponding to inter- and intra- 
modular synchronization increases with decreasing value 
of r [Fig. 5(b)]. Note that, the Laplacian spectra for WS 
networks does not exhibit a gap, indicating that the differ- 
ent time-scales for local and global synchronization origi- 
nate from the modular organization (Fig. 6). 

To relate this analysis with the diffusion process, we 
note that the transition probability from node i to j at 
each step of the random walk is Py = Aij/ki. This tran- 
sition matrix P is related to the normalized Laplacian of 
the network as J£ = I — D 2 PD~ , where I is the identity 
matrix [18]. The eigenvalues of P are all real, the largest 
being 1 while the others are related to the different diffu- 
sion time-scales. As in the synchronization example, the 
spectrum of P for modular random network exhibits a 
gap reflecting the existence of distinct time-scales in the 
system. Note that, although the above result strictly ap- 
plies only when linear approximation is valid, we observe 
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Fig. 7: The adjacency matrix showing connections between 
different cortical areas in the cat (top left, N = 65) and 
macaque (top right, N = 47) cerebral cortex. The broken 
lines indicate clusters of cortical areas (labelled I- IV) that are 
densely connected within themselves. This structural division 
reflects, to some extent, the functional segregation among the 
different cortical areas (e.g., visual, somatosensory, etc.). The 
rank-ordered reciprocal eigenvalues of the corresponding lapla- 
cian matrices (bottom) show well-defined spectral gaps, consis- 
tent with the existence of a modular structure for the cortico- 
cortical networks. The multiple gaps indicate that synchro- 
nization between different modules occur at different times. 



the property of time-scale separation predicted for modu- 
lar networks to be a much more general phenomenon. In 
particular, the strong nonlinear interactions of the Ising 
model cannot be even approximately treated by the Lapla- 
cian analysis. Nevertheless, we see almost identical behav- 
ior for all three processes, indicating the universality of the 
dynamical signature of modular networks. 

The above distinction between the dynamical behavior 
for different SWN models can be empirically tested by 
considering the cortico-cortical networks in the brains of 
cat [34] and macaque [35] which have been reported to 
possess clustered small- world properties [8]. Fig. 7 shows 
the existence of gaps in the Laplacian spectra of these net- 
works, suggesting a modular organization of the connec- 
tions between the cortical areas. This is consistent with 
the fact that local synchronization within a cluster has 
functional importance in the brain, whereas global coher- 
ence of activity may be undesirable. This example sug- 
gests that at least some of the SWN reported in nature 
may have modular organization with significantly differ- 
ent dynamical behavior from the WS or related models. 

In this paper, we have shown that modular networks, al- 
though they exhibit all the structural features associated 
with SWN, have the striking feature of multiple discrete 
time-scales, in contrast to WS and related models. As 
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dynamics at the local and global levels may have differ- 
ent consequences in most natural systems, the temporal 
separation between processes occurring at distinct scales 
through modular organization underlines the importance 
of such network structures. We suggest that this facil- 
itation of time-scale separation could be the reason for 
the ubiquity of modularity in real-world networks, where 
it can emerge through multi-constraint optimization [36]. 
It is being increasingly recognized that SWN mediate 
processes of critical importance to society, including the 
spreading of epidemics such as SARS [37]. To prevent 
an initially local perturbation from rapidly spreading and 
evolving into a global threat requires an intelligent inter- 
vention strategy that should take into account the under- 
lying network structure, such as modules, which governs 
the collective dynamics of the system. 
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